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I.  INTRODUCTION 


1.1.  General 

This  thesis  considers  the  limiting  behavior  of  the  fixed-interval 
smoothing  problem  for  singularly  perturbed  linear  systems.  Its  primary 
objective  is  to  derive  a near  optimal  smoother  for  a system  containing  both 
fast  and  slow  modes  by  employing  the  methods  of  singular  perturbation  theory. 
Recently  [l],  the  linear  filtering  problem  for  singularly  perturbed  systems 
has  been  thoroughly  treated  using  these  methods.  Considerable  attention 
has  been  given  to  singularly  perturbed  systems  as  applied  to  control  problems 
in  recent  years  [2-8].  Haddad  and  Kokotovic  [9]  have  established  the  duality 
between  estimation  and  control  for  such  systems.  The  one  fundamental 
difference,  however,  is  that  while  in  most  control  applications  the  problem 
is  deterministic,  in  the  estimation  problem  the  presence  of  white  noise 
inputs  complicates  the  behavior  of  the  resulting  fast  variables.  It  should 
be  noted  that  the  work  presented  here  is  an  extension  of  the  methods  and 
results  of  the  linear  filtering  problem  [l,9,10].  While  the  smoothing  problem 
has  already  been  treated  in  [10],  the  approach  used  here  is  more  suitable 
for  the  decomposition  of  the  smoother  into  its  fast  and  slow  components,  and 
in  deriving  the  uncoupled  boundary  layers  of  the  fast  mode  filters  at  both 
ends  of  the  observation  interval. 
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Singularly  perturbed  systems  are  represented  by  state  variable 
equations,  where  a small  perturbation  parameter  p > 0 multiplies  some  of 
the  derivatives.  This  general  form  is  characteristic  of  many  practical 
systems,  where  p.  “ay  represent  the  smaller  time  constants  of  the  system. 
Therefore,  such  a formulation  is  representative  of  systems  with  fast  and 
slow  modes,  e.g.,  velocity  and  acceleration  of  a maneuvering  vehicle,  or 
an  electro-mechanical  system  where  the  electrical  response,  as  is  typical, 
is  much  faster  than  the  mechanical  response. 

The  theory  of  singular  perturbations  has  arisen  from  a desire  to 
simplify  the  higher  order  problem  as  a set  of  two  lower  order  problems. 

This  not  only  allows  a simplification  of  the  solution,  but  in  addition, 
provides  for  non- interactive  estimation  or  control  of  the  fast  and  slow 
states.  It  also  generally  results  in  a great  reduction  in  computational 
complexity  and  removes  ill-conditioning.  In  this  thesis,  the  behavior  of 
the  optimal  smoother  for  singularly  perturbed  systems  as  p,  -*  0 will  be 
investigated  and  near  optimal  lower  order  smoothers  will  be  designed. 

1.2.  Problem  Statement 

1.2.1.  General  Problem 

The  problem  is  to  derive  a near  optimal  MMSE  (Minimum-Mean-Squared 
Error)  fixed-interval  smoother  for  the  singularly  perturbed  system 
represented  by  state  equations 

x - AjX  + A^z  + B jU  * x(0)  - xQ 


(1.1) 
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p-z  = A^x  + A2z  + B2u  , z(0)  = zQ  (1.2) 

and  observations 

y = C^x  + C2z  + v,  0 S t S T (1.3) 

Here  x,  y,  and  z are  n-,  r-,  and  m-dimensional,  respectively.  The 
vectors  u and  v are  p-  and  r -dimensional  uncorrelated,  white  Gaussian 
noise  processes  with  zero  means  and  respective  covariances  Q and  R,  i.e., 

E[u(t1)u'(t2)]  = Q(t)6(t1  - t2) 

E[v(t1)v* (t2)]  = R(t)6(tx  - t2)  (1.4) 

E[u(t1)v'(t2)]  = 0 

where  the  prime  is  used  to  denote  transpose.  The  states  x(t)  and  z(t) 
represent  the  slow  and  fast  modes  of  the  system,  respectively.  This 
characterization  is  explained  in  terms  of  the  eigenvalues  of  the  correspond- 
ing equations  (1.1)  and  (1.2).  The  latter  have  eigenvalues  that  behave  as 
1/p.  and  hence  tend  to  be  very  large  as  p.  •*  0. 

As  previously  mentioned,  this  thesis  is  mainly  concerned  with  the 
behavior  of  the  smoothed  estimates  of  the  states  of  (1.1)  and  (1.2)  as 
p,  -*  0,  and  obtains,  as  a result,  a near  optimal  lower  order  smoother  in 
two  time-scales  as  in  the  filtering  problem  [1,9,10].  The  interpretation 
of  near  optimality,  in  this  case,  is  in  the  sense  that  the  solution  tends 
to  the  optimal  as  p.  approaches  zero.  Formally,  such  limiting  behavior  will 
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be  denoted  by  using  the  following  definition:  A function  f(p.)  is  denoted 
0(p.)  if  there  exist  positive  constants  p,*  and  C such  that  the  norm  l|f|| 
satisfies  ||f||  < Cp,  for  all  p,  € (0,p.*]  . Thus  x(t)  = x(t)  + 0(p,)  implies 
x(t)  - x ( t ) - 0(p),  i.e.,  x(t)  is  an  0(p)  approximation  of  x(t). 

1.2.2.  Mode  Separation  for  Singularly  Perturbed  Systems 

Inspection  of  the  system  (1.1)-(1.3)  reveals  coupling  between  the 
slow  and  fast  states,  x(t)  and  z(t).  Algebraic  complexity  in  the  sequel 
can  be  reduced  by  an  initial  non-singular  linear  transformation  due  to 
Chang  [ll].  This  allows  consideration  of  systems  of  block  diagonal  form, 
thus  simplifying  the  intermediate  derivations.  If  the  matrices  of  (1.1)-(1.3) 
are  all  continuous  and  bounded,  and  A2(t)  is  also  stable,  then  this  trans- 
formation can  be  employed  to  yield  new  state  vectors,  T|(t)  and  §(t),  defined 
by 
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(1.5) 


where  I is  a k X k identity  matrix,  and  L and  H are  deterministic  matrices 
satisfying 


p>L  * A^L  — A2^  " m>I*(A^  — A^L) 

p,H  - - H(A2  + p,LA12)  + A12  + p.(A1  - A12L)H 


(1.6) 


It  can  be  shown  that  the  stability  of  A^(t)  implies 


I 

I 

I 

L - A2  A21  + °(tA)  £ L0  + °(^) 

' H «=  A^A'1  + 0(n)  A HQ  + 0(h) 

The  new  state  equations  and  associated  observations  become 

■n  m*o*  +/V’  ^°)  = ^0 

H ( “*2?  + B2 u,  5(0)  = 5q 

y = C-qII  + C-2§  + v,  0 < t < T 

where 

X Q = A1"A12L  = A1-A12A21A21+0(h)  A Aq+0(h) 

8q  = B1-hHLB1-HB2  = B1-A12A21B2-+0(h)  a B0-K)(h) 

C-q  * Cl-c2L  *=  c1-c2a'1a21-k)(m,)  a Cq-K)(h) 

^ 2 “ A2+hLA^2  = A240(h) 

/f?2  ■ B^p-LB^  - B2+0(h) 

&2  - C2+h(C1-C2)H  - C2-K)(|i) 

Since  only  linear  estimators  are  considered  here,  the  estimates  of  the 
original  states  can  be  obtained  via  the  inverse  transformation 
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(1.7) 

(1.8) 
(1.9) 

(1.10) 


(1.11) 


(1.12) 
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where  H and  L may  be  replaced  by  ( 1. 7 )>  depending  on  the  desired  approximation. 
Therefore,  without  loss  of  generality,  the  discussion  will  be  restricted  to 
the  uncoupled  system  (1 .8) -(1 . 1 0) . Finally,  the  inverse  transformation 
(1.12)  will  be  employed  to  find  the  estimates  of  the  original  states. 

1.2.3.  The  Reduced-Order  Problem 

Observation  of  the  general  smoothing  problem  reveals  that  if  u = 0, 
the  result  is  a lower  order  system  whose  solution  is  much  simpler  than  that 
of  the  original,  higher  order  system.  A basic  problem  in  singular  perturba- 
tion theory  is  the  relationship  of  the  complete  or  exact  solution  to  the 
solution  of  the  reduced-order  problem.  Hence,  a reduced-order  problem  is 
defined  in  this  section  by  formally  setting  pi  ■ 0 in  (1. 1)-(1.3)  or 
equivalently,  in  ( 1 .8)- (1 . 10) . Setting  pi  - 0 in  the  latter  yields 

“ - A‘lB2u(t)  (1.13) 

and  thus , 

^o-Vo  + V (1*14) 

y “ C0T|0  + V + v (1,15) 

where  DQ  A - C^1^. 

A major  objective  of  this  work  is  to  investigate  the  limit  of  the 
smoothed  estimate  of  the  complete  system  as  pi  -•  0 and  its  relation  to  the 
smoothed  estimate  for  the  reduced-order  problem.  It  will  be  shown  that  while 
the  resulting  limit  is  identical  to  the  reduced-order  problem  for  the  slow 
modes,  it  is  not  valid  (as  is  expected)  for  the  fast  modes. 
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1.2.4  General  Assumptions 

The  following  assumptions  will  be  needed  throughout  this  thesis: 

(i)  The  matrices  A2<t),  C^Ct),  Q(t)  and  R ^(t)  are  continuous, 

bounded,  and  have  bounded  first  derivatives  for  all  t £ [0,T], 

(ii)  The  eigenvalues  of  A^(t)  have  negative  real  parts  (a  stable  matrix) 
for  all  t € [0,T] . 

1 . 3 Thesis  Preview 

Chapter  II  investigates  the  proposed  formulation  of  the  solution 
to  the  fixed-interval  smoothing  problem.  The  exact  solution  for  the  complete 
system  is  outlined  and  the  reduced-order  problem  is  explicitly  solved. 

Chapters  III  and  IV  consider  the  limiting  behavior  of  the  forward 
and  backward  filters  respectively,  for  the  exact  smoothing  problem  and 
investigate  its  relation  to  the  solution  of  the  reduced  problem. 

The  near  optimal  smoother  as  a two  time-scale  lower  order  estimator 
is  derived  in  Chapter  V.  It  is  shown  that  the  slow  mode  smoother  tends  to 
the  smoother  for  the  reduced  system.  The  fast  mode  smoother,  it  is  seen, 
involves  the  forward  and  backward  fast  mode  filters  both  of  which  are 
implemented  in  a stretched  time-scale. 

Chapter  VI  is  concerned  with  the  general  stationary  second-order 
case,  in  which  comparisons  can  be  made  relatively  easily  between  the  fast 
mode  estimators  and  the  corresponding  Wiener  filters.  Finally  a numerical 
example  is  considered  to  illustrate  the  validity  of  the  near  optimal  design. 

Chapter  VII  concludes  this  thesis  with  a summary  of  the  results 
and  conclusions  of  the  previous  chapters. 


II.  GENERAL  SOLUTION  OF  THE  SMOOTHING  PROBLEM 

2 1 . Smoothing  as  a Combination  of  Two  Filters 

Consider  the  MMSE  smoothing  problem  for  a system  of  thp  form 

x = Ax  + Bu 

y = Cx+v  , 0 < t < T 

The  optimal  fixed-interval  smoother  for  this  system  can  be  expressed  as 
a weighted  sum  of  two  filters  [12,13).  The  estimate  of  x(t).  given  all 
observations  in  the  interval  [0,T],  is  given  by 

x(t|T)  = F(t)x(t)  + (I-F(t))xb(t) 

* A 

where  x(t)  is  the  output  of  the  usual  Kalman  filter,  xfe(t)  is  the  output 

of  a backward  Kalman  filter,  and  F(t)  will  be  chosen  to  minimize  the 
MSE.  The  forward  filter  processes  the  observations  in  the  interval  [0,t 
and  the  backward  filter  processes  the  remaining  ones  from  T back  to  t. 
The  smoother  error  covariance  is  given  by 

P(t|T)  = E{[x(t|T)-x(t)][x(t|T)-x(t)] '}  * FP(t)F ' + (I-F)Pb(t) (I-F) ' 

where  P and  Pb  are  the  error  covariances  of  the  forward  and  backward 
filters,  respectively.  Choosing  F(t)  to  minimize  the  trace  of  P(t|T) 
results  in 

F = P^P+Ph)"1  , I-F  = P(P+Pb)_1 
with  corresponding  error  covariance 

P(t  | T)  = [P_1(t)  +Pb1(t)f1  = [P'V)  +M(t)] 


(2.1) 

(2.2) 


(2.3) 


) 


(2.4) 


(2  5) 


(2.6) 


The  resulting  optimal  smoother  becomes 


x(t | T)  = P(t|T)[p'1(t)i(t)  +M(t)ib(t)]  (2.7) 

The  backward  filter  equations  given  by 

jjj  xfa(t)  = - A ^ + P C 'R_1(y-C  ^),  a = T - t S 0 (2.8) 

& pb  ‘ • APb  • V'  + - pbc'R‘lcPb’  pb1<T)  ‘ 0 (2  ?) 

are  unstable  however,  and  in  fact, P^(T)  is  not  finite,  a consequence  of 

filter  and  smoother  equivalence  at  the  end  of  the  observation  interval. 

A a 

Hence,  a stabilizing  transformation  s(t)  = M(t)xb(t)  is  used,  resulting  in 

= (A'  -MBQb')s  + c'  R_1y  , s(T)  = 0 (2.10) 

It  should  be  noted  that  the  error  covariance  of  s(t)  is  M(t),  which  satisfies 
the  Riccati  equation 

dj^  = MA  + A'M  - MBQb'm  + c'r"1C  , M(T)  * 0 (2.11) 

do 

In  what  follows  o = T - t will  always  be  used  to  denote  the  backward  time 
variable.  However,  all  matrices  will  be  expressed  as  functions  of  t for 
consistency.  The  smoothed  estimate  (2.7)  therefore  becomes 

x(t|T)  - [I+P(t)M(t)]_1[x(t)  +P(t)s(t)]  (2.12) 

While  the  quantities  s(t)  and  M(t)  do  not  have  the  physical  meaning  of  their 
forward  counterparts  x(t)  and  P(t),  they  do  suggest  a convenient  mathematical 
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representation  for  the  implementation  of  x(t|T).  Equations  (2.10)  - (2.12) 
above  will  be  applied  directly  to  the  reduced-order  smoothing  problem  and 
later,  also  to  the  exact  smoothing  problem  using  the  complete  system. 


2.2.  The  Reduced -Order  Smoothing  Problem 

The  smoothing  problem  for  the  reduced  system  (1.14)  - (1.15)  will 
now  be  considered  by  directly  applying  the  results  of  section  2.1  with  the 
modification  required  due  to  the  correlation  of  the  input  and  measurement 
noises.  The  resulting  fixed-interval  smoothing  solution  for  this  system 
becomes 

T^(t|T)  = (I+P0M0)‘1[\(t) +P0s0(t)]  (2.13) 

where  T|q  and  s^  are  the  outputs  of  the  forward  and  backward  filters  with 
covariances  Pq  and  Mq,  respectively.  The  expression  for  the  forward  filter 
is  given  by  the  usual  Kalman  filter  equation 

= Vo  + Vy-coV  > V0)  = E<V  <2-14> 

where 


*o 4 <poco+w;>Ro1 

»0  4 (R+B0QD^) 


(2.15) 

(2.16) 


with  the  error  covariance  PQ(t)  satisfying 


po  * Vo  + Vo  + VBd  • <poco  ♦WXVo  +00<!Bd>’  po(0)  ' C°v<-V 

(217) 

The  backward  filter  equation,  obtained  from  (2.10)  with  the  noted  modification. 


4 • 


•v 
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1 I 

I 

I Is  expressed  as 

1 3T ' IAi  - <MoBo  + Vo^^o  + V>  ‘o<T>  ‘ 0 <2-18> 

where 

Vl>  ■ <co  • Vo'f’X1  (2-19) 

The  corresponding  covariance  equation  for  Mq  is  obtained  similarly  from 
(2.11)  as 

dM0 

5T  ■ Vo  + AiMo  ' MoBoQBoMo  + Wi-  Mo<T>-°  ■ <2-20> 

In  summary,  the  optimal  smoother  for  the  reduced  system  is  given  by  (2.13), 
together  with  eqs.  (2.14),  (2.17),  (2.18),  and  (2.20). 

2.3.  Exact  Solution  of  the  Smoothing  Problem 

The  exact  solution  of  the  smoothing  problem  for  the  system  (1.8)  - 
* (1*10)  can  be  found  by  applying  the  results  of  Section  2.1  directly,  with 


the  appropriate  substitutions 


I 

I 

l 

where  the  terms  have  been  neglected  In  the  coefficients  of  the  right-hand 
side  of  (1.8)  - (1.10).  If  p.  is  not  to  be  neglected,  the  script  matrices  of 
(1.11)  should  be  used.  In  accordance  with  eq.  (2.12),  the  smoothed 
estimate  will  therefore  be  given  by 


^(t |T) 

£ (t | T) 


- [I  +P(t)M(t)] 


A 


/ si(t)\ 

+ p(t)(  I 

\M,S  (t)/ 


(2.21) 


. A 

where  P = 

P1 

P12 

is  the  covariance  of  the  forward  filter  output 

A 

T1 

T 

P12 

P2/u 

i 

A 

and  M * 


M uM 
1 W112' 


ri2  ^ 


is  the  covariance  of  the  backward  filter  output 


The  reason  for  the  particular  partitionings  of  s(t)  and  M(t)  will  be 


apparent  in  the  sequel. 


[ 

I 

T 

I 

I 

I 

I 


The  equations  for  the  forward  filters  and  their  covariances,  obtained 
from  the  usual  Kalman  filter  equations  with  the  above  partitioning,  are 
as  follows 


n5 


V + (P1Co+P12C2)R"1(y'C0^'C2^)’ 

a2?  + <^pl2co  +P2C2)R'1(y-c0^i -c25). 


71(0)  = E(T|0) 

(2.22) 

5(0)  = E(^) 

(2.23) 

V ..  w 


P1  = Aopi  + P1A0  + BoQBo 


^P12  = »Vl2  + P12A2  + B0QB2 


(P1C0+P12C2)R"1(C0P1+C2P12)'  Pl(0)  = cov(V 

(2.24) 

' (PlC0+P12C2)R"1(lAC0P12+C2P2)'  p12(°>  = cov<T10>?0) 

(2.25) 


|ip2  - A2P2  + ?2A'2  + - (^P^2Cq+P2C2)R'1(C2P2 +^C0P12),  ^ (0)  = cov(?0) 

(2.26) 

Note  that  since  the  covariance  of  the  fast  state  ?(t)  behaves  as  O(l/p0> 
the  error  covariance  of  its  estimate  has  been  denoted  by  P2/>a- 

Similarly,  applying  equations  (2 . 10)- (2 . 11),  after  the  appropriate 
partitioning,  yields  the  backward  filter  equations  for  s^,  s2  and  their 
covariances  as  given  below 


ds 


— = <a;  -M^QB*  -M12B2QB’)8i  - (MlB0  +H12B2)Qb;s2  + y,  s^T)  = 0 

(2.27) 


ds. 


^ - * (^Mj2B0+M2B2)QB^)s1  + (A2  - MM^QBj  -MjBjQB^Sj+CgR^y,  s2(T)  = 0 

(2.28) 


dM 


«T  • A'oHl  + M1A0  + Ci*'‘C0  ' <"lB0  +M12B2><«Bi"l+8X2>'  M1(T)  ' ° 

(2.29) 


dM 


»*  “ ^AiM12  + M12A2  + C0R'1c2  ' (M1B0  +m12b2)Q(M,BqM12  + 8^).  M^d)  = 0 

(2.30) 


dM 

“ ST  ~ A2"2  + «2A2  + C2B‘1c2  ' ("li'o  + «2B2>,!<B2M2  +“BiM12)’  M2(T)  ' ° 


(2.31) 
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The  form  adopted  for  s(t)  as 


M«s„ 


Is  required  to  yield  for  82(f)  the 


same  role  in  (2.28)  as  S(t)  in  (2.23).  This  also  produces  M*(t)  = 


as  the  covariance  of  the  vector 


M1  M12 
m;2  m2/u| 


, similar  to  P(t). 


Inspection  of  (2.22)  - (2.31)  reveals  that  the  backward  filtering 
solution  is  a dual  to  the  forward  filtering  solution,  where  the  roles  of 
a',  b',  c',  and  R * are  interchanged  with  those  of  A,  C,  B,  and  Q 
respectively.  Comparison  of  (2 .29)  - (2 .31)  to  (2 .24)  - (2 .26) , for  instance, 
reveals  that  and  are  the  exact  duals  of  P^,  P12»  and  p2  for 

the  forward  filter.  Also,  if  the  innovation  term  of  (2.22)  and  (2.23)  is 

A A 

broken  up  into  its  components  y,  1],  and  ?,  it  is  easily  seen  that  the 
coefficients  of  s^(t)  and  s2(t)  of  (2.27)  and  (2.28)  are  perfect  duals  to 

A A 

those  of  T) (t ) and  ?(t)  respectively.  The  fact  that,  of  all  these  equations, 
only  the  coefficients  of  y(t)  are  not  duals  is  essentially  a result  of 
the  absence  of  an  innovation  term  in  the  backward  filter.  Any  attempt  to 
form  such  a term  in  a filter  equation  describing  s(t)  would  involve  using 
the  unstable  quantity  P^(t) . Overall,  this  duality  property  will  prove  to 
be  extremely  useful  as  a time  saving  tool,  as  will  be  seen  in  the  following 
chapters.  In  what  follows,  the  limiting  behavior  of  the  Riccati  equations 
(2.24)  - (2.26)  and  (2.29)  - (2.31)  will  be  considered.  Subsequently,  the 
limiting  behavior  of  the  resulting  filters  (2.22)  - (2.23)  and  (2.27)  - (2.28) 


will  be  derived. 


2.4.  Remarks 


In  summary  of  the  preceding  Section  2.3,  it  should  be  noted  that 
substitution  of  the  exact  filters  and  covariances  as  given  by  (2.22)  - (2.26) 
and  (2.27)  - (2.31)  in  equation  (2.21)  would  yield  the  optimal  fixed-interval 
smoother  for  the  system  (1.8)  - (1.10). 

The  purpose  of  this  chapter  was  to  introduce  the  proposed  formu- 
lation and  indicate  the  tremendous  complexity  involved  in  solving  for 
the  optimal  smoother  using  the  full  system,  in  addition  to  the  ill-conditioning 
of  such  a problem.  The  reduced-order  smoother  has  also  been  studied. 

It  was  seen  to  be  quite  simple  to  solve  and  thus  implement  and,  as  will  be 
shown  in  Chapter  V,  the  smoother  for  the  slow  states,  T| ( 1 1 T) , tends  to 

this  smoother  for  the  reduced  system  as  p.-’O.  Thus,  this  simple  smoother 

JL 

can  be  used  as  a near  optimal  (within  0(p-2)  approximation)  estimator  for 
the  slow  variable  T] ( t ) . 

The  proposed  smoothing  formulation,  as  a weighted  sum  of  near 
optimal  filters,  will  have  a limiting  behavior  which  is  extremely  simple  to 
analyze  in  terms  of  the  limiting  behavior  of  these  composite  filters. 
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III.  THE  FORWARD  FILTER 

3.1.  Limits  of  the  Riccati  Equations 

In  this  chapter  the  limits  of  the  forward  filter  as  ^"*0  are 
investigated.  For  that  purpose,  it  is  necessary  to  first  study  the  limits 
of  the  Riccati  equations.  Ihese  will  be  needed  in  determining  the 
limiting  behavior  of  both  the  filter  and  the  smoother. 

It  has  been  shown  [1,9,10,14]  that  the  filter  error  covariance 
matrices  P^2(t)  and  P2(t)  as  given  by  eqs . (2.25)  and  (2.26)  can  be 
expressed  to  within  an  0(p.)  approximation,  by  the  sum  of  quasi  steady- 
state  and  boundary  layer  terms  [2-8],  i.e., 


P12(t)  = P12(t)  +P12(0)  + °^)  (3-D 

P2(t)  « P2(t)  + P2(0)  + O0O  (3.2) 

where  0 = t/(i.  The  quasi  steady-state  terms  P^(t),  P.^^)*  anci  P2(t)  are 
obtained  by  setting  (i  = 0 in  (2.24)  - (2.26)  and  thus,  satisfy  the  following 
equations : 


P2A2  + A2P2  + B2QB2  - P2C2R"1c2P2  = ° 


(3.3) 


P12  - - [BqQB2  - P1(t)CQR*1C2P2]A2"1 


(3.4) 


P1  ■ Vl  + P1A0  * B0QB0  - <P1C0  +P12C2»R'1<C0P1  +C2pl2>-  Pl(0)  " COV(V 


(3.5) 
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where 

A2(t)  = A2  - P2C2R_1C2  (3.6) 

Note  that  P2(t)  is  the  positive  semidefinite  root  of  (3.3).  The  boundary 
layer  terms  P2(0)  and  P^2(0)  satisfy  the  homogeneous  equations 


^p2(0)  = a2(0)p2(9)  +p2(0)a’(O)  - p2(0)c2R'1c2P2(e)  +0(H), 


P2(0)  = ^cov  (?Q)  - P2(0) 


(3.7) 


^P12(0)  = P12(®)[A2(0)  -C2R-1C2P2(0)]  - [P1(O)Cq+P12(O)C2]R-1C2?'2(0)  + 0(h) 


P12(0)  = cov(Tl0,|0)  - P12(0) 


(3.8) 


Since  A2(0)  is  stable,  for  any  t > 0 the  boundary  layer  terias  tend  to  zero 
exponentially  fast  as  H ”* 0.  Hence  for  t > £ 0,  both  terms  become  0(H). 

Consequently,  on  a subinterval  te[£,T],  £ > 0,  the  quasi  steady-state 
terms  alonq  may  be  used,  i.e., 


P2(t)  = P2(t)  + 0(H) 

(3.9) 

12  (t)  “ P12(t)  + 0(H) 

(3.10) 

It  is  also  easily  seen  that  since  the  boundary  layer  of  P^2  appears  only 
in  the  forcing  term  of  (2.24),  its  effect  on  P^(t)  is  0(h),  and  thus  the 
covariance  P^  can  be  approximated  for  all  te[0,T]  by 


* 
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Px(t)  = Px(t)  + 0(H)  (3.11) 

To  avoid  any  future  confusion,  it  should  be  noted  that  P^(t),  P^2(t), 
and  P2(t)  were  found  by  setting  pi  = 0 in  (2.24)  - (2.26)  which,  in  general, 
is  not  equivalent  to  the  steady-state  obtained  by  setting  the  derivatives 
to  zero  in  the  same  equations.  Hence,  the  term  "quasi  steady-state" 
has  been  used. 

3.2.  Limiting  Behavior  of  the  Fast  Mode  Filter 

In  considering  the  limit  of  the  fast  mode  filter  (2.23),  two  cases 

are  of  interest.  The  first  is  when  the  fast  mode  estimate  is  of  interest 

in  itself.  In  this  case,  the  limits  of  the  Riccati  equations  for  P^  and 

?2 > together  with  the  results  of  Theorem  1 of  [1],  allow  the  implementation 

1/2 

of  the  fast  mode  filter,  to  within  an  0(pi  ) approximation,  as  a stationary 
filter  in  a stretched  time-scale.  That  is, 

S = % + 0(H1/2)  (3.12) 

where  §(t)  satisfies 


£ ' - *2<tt)5  + P2(t1)o;if1(y-C0TI-C2S> 

t-t  . 

for  all  t.  > t > t.  £ £;  £ > 0,  and  T = > 0 . (3.13) 

irl  i. 


Note  that  the  small  subintervals  [ t ^ , t ^ ] form  a subdivision  of  the  obser- 

« -1/2 

vation  interval  (0,T] . Since  the  covariance  of  ? behaves  as  1/pi,  ? is  0(p  ), 

* 1/2  1/2 

and  thus  pi5  is  0(pi  ),  hence  the  0(M>  ) approximation.  Near  the  initial 

point  (t=0)  of  the  observation  interval,  P2(t)  must  be  augmented  by  the 
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boundary  layer  term  P2(6)>  so  that  the  filter  is  no  longer  time-invariant. 

The  second  case  to  be  considered  is  when  ?(t)  is  to  be  used  only 
as  an  input  to  the  slow  mode  filter.  Under  such  circumstances,  5 can  be 
replaced  by  its  white  noise  approximation  (Theorem  1 of  [1])  obtained  by 
setting  [1  = 0 in  (2.23)  and  (2.26).  This  substitution,  valid  for 
t > £ > 0, is  given  by 

c2?0  = ■ s^w’^y-c^)  <3-14) 

It  should  be  noted  that  (3.14)  does  not  yield  an  approximate  estimate  of 
the  fast  variable,  but  is  only  a valid  approximation  when  £ is  to  be 
used  as  an  input  to  slow  systems. 

3.3.  Limiting  Behavior  of  the  Slow  Mode  Filter 

The  limit  of  the  slow  mode  filter  is  obtained  from  (2.22)  by 
substituting  P^,  P^ « and  ?q  as  given  by  (3.5),  (3.4)  and  (3.14)  respectively. 
The  resulting  filter  becomes 

T\  = AqT1  + Kx(y  -C0T1)  + 00*  ' ),  0 < t < T (3.15) 

where 

Kj  - (3-16) 

It  can  be  easily  shown  (with  some  lengthy  matrix  algebra  as  in  [1])  that 
the  slow  mode  filter  tends  to  the  filter  for  the  reduced  system  as 
namely  that 


j- 


where  Kq  and  are  given  in  Section  2.2  for  the  reduced  problem.  This 

result  is  quite  significant  in  that  it  justifies  the  solution  of  a much 

simpler  reduced-order  problem  for  estimating  the  slow  mode,  and  can  be 

summarized  by  * „ 

H = T)0  + 0(M.  ' ) , 0 £ t < T (3.17) 

3.4.  Boundary  Layers 

The  notion  of  "boundary  layers"  has  been  introduced  in  this 
chapter  for  the  forward  filter.  To  yield  some  insight  as  to  why  the 
boundary  layer  correction  terms  were  proposed  for  the  fast  mode  filter  and 
their  subsequent  role  in  the  fast  mode  smoother  (to  be  derived  in  Chapter  V), 
a discussion  is  in  order. 

Inspection  of  equations  (2.23),  (2.25),  and  (2.26)  representing 
5,  > and  P2  respectively,  reveals  that  as  p.-’O,  the  associated  derivatives 

tend  to  become  quite  large.  A quasi  steady-state  solution,  as  was  found 
for  P^  and  P2 , ignores  the  required  boundary  conditions  of  these  equations. 
Thus,  there  is  a small  initial  time  interval  [0,£)  where  the  system 
experiences  the  rapid  decay  of  these  fast  transients.  The  boundary  layer 
terms,  which  die  off  quickly  as  time  increases  slightly,  are  required  to 
account  for  the  large  discrepancy  between  the  exact  and  reduced  solutions  near 
the  initial  point  of  the  observation  interval.  Since  the  equation  (2.23)  for 

A 

P is  not  reduced  (that  is,  when  the  behavior  of  the  fast  mode  is  of  interest), 
the  only  correction  terms  needed  are  those  associated  with  the  covariances 
P^2  and  P^  in  the  input  term  of  that  equation.  However,  since  the  P^  term 
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is  0(p,)  in  (2.23),  only  need  be  augmented.  It  can  be  easily  seen  [1] 

* 

that  just  as  the  "white  noise  approximation"  was  valid  as  an  input  to  the 
slow  mode  filter,  so  is  the  quasi  steady-state  covariance  multiplier  P^^)* 
i.e.,  there  are  no  boundary  layers  for  the  slow  mode  filter. 

The  duality  of  the  backward  filter  will  present  an  essentially 
identical  problem  with  respect  to  the  boundary  layers  (this  time  occurring 
only  near  t = T)  and  thus,  in  view  of  the  forward  filtering  results,  the 
boundary  layer  compensation  will  be  obvious.  Finally,  the  near  optimal 
smoothing  solution,  as  will  be  seen  in  Chapter  V,  will  not  offer  much 
additional  difficulty  due  to  the  uncoupled  boundary  layers  of  the  composite 
forward  and  backward  filters. 

3.5.  Summary 

In  this  chapter  it  has  been  shown  that  a near  optimal  fast  mode 
filter  can  be  designed  using  a stretched  time-scale  implementation  with 
innovation  input.  A time -invariant  filter  suffices  for  any  small  subinterval 
of  [£,T],  t > 0.  This  filter  uses  an^  therefore,  if  the  filter  is  to 
be  valid  near  t = 0,  the  appropriate  boundary  layer  term  P^Q)  must  be  added 
so  that  the  filter  becomes  time-varying. 

For  the  behavior  of  the  slow  mode  filter,  it  was  seen  that  the 
"white  noise  approximation"  to  ^(t)  was  valid.  As  might  have  been 
suspected,  the  slow  mode  filter  was  equivalent,  in  the  limit,  to  the  filter 
for  the  reduced  system. 

As  a final  note  to  this  chapter,  if  only  the  near  optimal  filtering 
solution  is  desired,  direct  application  of  (1.12)  yields  for  the  original 
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states 

« * 1/0 

x(t)  = 110(t)  + 0(n  ) (3.18) 

z(t)  * - L0^0(t)  + ?(t)  + 0(n1/2)  (3.19) 

where  the  linearity  of  the  filters  has  been  used.  However,  for  later 

A 

use  in  the  smoothing  solution,  it  is  preferable  to  express  ?(t),  as  given 
by  (3.13),  as  a sum  of  uncoupled  filter  outputs,  i.e., 

* = C + A2  P29  CqT|0  + 0(U1/Z)  (3.20) 

and  thus,  Q satisfies  the  decoupled  equation 

j - - _ , _ t-t 

^ c - A2(ti)C  + P2(ti)C^R  (y-C2C),  T = -jpi  > 0 (3.21) 

A/  _ Ay 

Similarly,  £ (£  with  P2(®)  added)  would  be  the  time-varying  uncoupled  filter 
output  valid  over  the  entire  interval. 


V 


• it 
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IV.  THE  BACKWARD  FILTER 

4.1.  Limits  of  the  Riccati  Equations 

In  this  chapter  the  techniques  used  in  Chapter  III  for  the  forward 
filter  will  be  applied  to  the  backward  filter  as  well.  As  was  the  case 
with  the  forward  filter,  the  limits  of  the  corresponding  Riccati  equations, 
(2.29)  - (2.31)  here,  must  first  be  examined  before  deriving  the  limiting 
behavior  of  the  backward  filter. 

Section  2.3  established  the  duality  relationship  between  the 
forward  and  backward  filters  and  covariances,  thus  simplifying  the 
analysis  to  a great  extent.  In  accordance  with  this  duality,  the  backward 
filter  covariances  can  be  approximated  to  within  0(h)  for  all  t e[0,T] 
as  follows 

Mx(t)  = M^t)  + 0(n)  (4.1) 

M12 (t)  - M12(t)  + M12(p)  + 0(h)  (4.2) 

M2(t)  = M2(t)  + M2(p)  + 0(h)  (4.3) 

where  p = — = . The  quasi  steady-state  terms  , M^,  and  , obtained 

by  setting  h = 0 in  (2.29)  - (2.31),  are  the  solutions  of 

M2A2  + A^M2  + C^R'1C2-M2B2QB^,M2  - 0 (4.4) 

Mi2  - -[C^R"1^  - Ml  (t)B0QB^M2]  X,"1  (4.5) 

dSl  - - -1 

+ MjAq  + CqR  Cq  - N(t)QN'(t),  Mt(T)  - 0 (4.6) 

respectively,  where 
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^2(t)  A A2  " m2B2QB2  (4.7) 

N(t)  ^ + M12B2  (4.8) 

and  M^t)  is  the  positive  semidefinite  root  of  (4.4).  The  boundary  layer 
terms  M^p)  and  M^(p)  satisfy  the  homogeneous  equations 

<ffi,(p) 

«'X£(T)M2(p)  +'?l2(p)'X2(T)  -,?l2(p)B2QB2^2(p)  + 0(n)  , 

p > 0,  fl2(p=0)  = -M^T)  (4.9) 

tffl12(p)  ~ _ 

— j-p — - M12(P)rX2(T)  - b2qb^H2(P)]  - [m1(T)b0  + m12(t)b2]qb^-m2(P)  +0(h), 

^12(P“0)  = -M12(T)  (4.10) 

Again,  due  to  the  stability  of  A2(T)  and  hence  *X  (T),  the  boundary  layer 
terms  decay  exponentially  fast  as  p,  -»  0 for  any  t < T.  Hence,  for  all 
t € [0,  T-£] , £ > 0,  the  approximations  given  by 


Mx(t)  = Mx(t)  + 0(h) 

(4.11) 

M12(t)  = ”l2(t)  + 0(^ 

(4.12) 

Mjj(t)  = M2(t)  + 0(h) 

(4.13) 

will  be  valid.  It  remains  to  be  seen  that  is  equivalent  to  the  reduced 
covariance  of  Section  2.2.  This  problem  will  be  considered  in  Section 
4.3. 
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4.2.  Limiting  Behavior  of  the  Fast  Mode  Filter 

The  exact  expressions  for  the  backward  filter  are  given  by 
equations  (2.27)  and  (2.28).  However,  in  order  to  obtain  the  behavior 
of  the  fast  mode  filter  alone,  these  filters  should  be  decoupled  by  employing 
a transformation  as  in  Section  1.2. 

Let  new  variables  w(t)  and  r(t)  be  defined  by 


w(t)  VmH^ 


s1(t) 

s2(t) 


(4.14) 


where 


ll  = -'X^'1m2b2qb^)  + 0(n) 

Hj_  = -N(t)QB2^_1  + 0(h) 


(4.15) 


(4.16) 


This  is  a non-singular  transformation  which  when  inverted  yields 

sx(t)  = w(t)  + 0(h1/2)  (4.17) 

S2(t)  = ^"1M2B2QB^)w(t)  + r (t)  + 0(h1/2)  (4.18) 

1/2  -1/2 
where  the  0(h  ) results  from  hs2  since  s2  is  0(h  )•  The  uncoupled  filters 

are  now  given  by 


- [Aq  - N(t)Q(I  + B^2"1M2B2Q)Bq]  w+  [C^R_1  + N(t)QB^*1C^R_1]  y +0(h1/2) 


+ C^R'ly  + 0(h1/2) 


(4.19) 

(4.20) 


The  equation  for  r(t)  is  a standard  singularly  perturbed  filter,  which  is  a 
strictly  fast  system  with  input  y(t)  containing  white  noise.  Hence,  its 


% 


limiting  behavior  is  similar  to  that  of  5, since  T?2  ) *-s  stable  for  all 

t €[0,T].  Consequently,  r(t)  may  be  approximated  by  the  output  of  a 

ff-01 

stationary  filter  implemented  in  a stretched  time-scale  X = , for  any 

small  subinterval  ai+1]c[e.T],  The  resulting  filter,  valid  for 

all  T - j < t £ T - ai  may  be  expressed  by 

= A^  (T-o.)  r(t)  + C^R_1y  + 0(ti1/2),  X > 0 (4.21) 

Near  the  right  endpoint  (t=T)  of  the  observation  interval,  it  is  necessary 
to  augment  M2  withft^p)  in'X^(t)  above,  so  that  this  fast  filter  is  no 
longer  time- invariant . 

4.3.  limiting  Behavior  of  the  Slow  Mode  Filter 

The  limiting  behavior  of  the  filter  output  w(t)  is  found  by  setting 
(j,  = 0 in  the  right-hand  side  of  (4.19)  (the  script  matrices  neglected  earlier 
are  actually  just  now  being  replaced).  This  results  in 

« [A^  -N(t)Q(I  + B2^_1M2B2Q)B^]  w + [ + N(t  )QB^‘  lC^ ] R ly  (4.22) 

Note  that  (4.17)  guarantees  that  s^(t)  also  satisfies  (4.22)  in  the  limit 
as  p,  0. 

Simple  matrix  algebra  must  now  be  performed  to  show  that  the  filter 
of  equation  (4.22)  is  identical  to  the  reduced-order  filter,  namely,  w(t)  = 
sQ(t)  as  given  by  (2.18).  This  is  essentially  the  same  task  as  for  the 
forward  filtering  case,  except  that  the  lack  of  an  innovation  term  in  the 
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I 

I 

I 

I 
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backward  filter  makes  it  more  tedious.  To  accomplish  this,  it  is  first 
necessary  to  prove  the  equivalence  of  and  Mg  as  given  by  equations  (4.6) 
and  (2.20),  respectively.  The  substitution  of  (4.4)  and  (4.5)  in  (4.8), 
after  lengthy  algebra,  yields  the  dual  to  equations  (63)  and  (64)  for  the 
forward  filter  in  [1].  These  expressions  are 

N(t)  = (M^g  + C^DgHl -B^A^"1M2B2Q)''1  (4.23) 

and 

N(t)Q(I  - B^-1M2B2Q)-1  = (M1B0  + C^R_1D0)(I  + QD^R"1D0)‘1Q  (4.24) 

The  further  substitution  of  (4.23)  and  (4.24)  in  (4.6)  yields  the  equation 


*^1  — — -1  — -1  -1-1—  -1 

3T-«iao  + aomi  + cor  co  * <MiBo  + ciR  V(I  + <!DoK  V <5<BoMi  + DoR  co> 

(4.25) 

If  the  following  two  identities  are  now  substituted  in  (4.25): 


(I  + QD'R-^o)'1  - I - 

“‘V^oWV'1  - 


(4.26) 

(4.27) 


the  resulting  equation  for  (4.25)  becomes 


dM 


_ _ .1  _ _ _ _i  _ _ .i 

dc  * mlao  + aoml  + coR  co " MiBoQBoMi + “iBoQDiRo  Wi  * Mi  Wo  co 

- co“o\®o5i ' c6ro1do,dor’1co 


(4.28) 


Additional  algebraic  manipulation  of  (4.28),  together  with  the  use  of  the 
identity 


<r  - ‘C'W'1  ‘ Ro‘ 


(4.29) 
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results  in 

d«i  - - - - - 

5T  ' Vo  + A6Mi  -MiBoQBoMi+  S 'VoW  <co ' <4-30> 

which  is  identical  to  (2.20). 

It  now  only  remains  to  be  shown  that  the  filter  coefficients  of 
(4.22)  are  identical  to  those  of  (2.18).  The  gain  coefficient  of  the  filter 
is  given  by 

(C^)  + N(t)QB^"1CpR'1  = [C^-N(t)Q(I-B^'1M2B2Q)*1D^]R'1 

" [co ' (Vo  + cor"1do)(i  + qdor"1do)"1qd61r'1  - (Cq-W^^o1  H *b 

(4.31) 

where  the  identities  (4.24),  (4.26),  and  (4.29)  have  been  used.  Similarly, 
the  system  matrix  of  (4.22)  is  given  by 


-N(t)Q(I  + B20^'1M2B2Q)B^)  - A'Q  - N(t)Q[I+  (I  - B’A^ ' M^QjB^ 

- Ai-N(t)Q<I-B^-lff2B2Q)-‘Bi  - (Vo  + CiE"lDo>(1  + QD0R’lDo)‘lQB0 

■ A6  - Wu  - DiRoV)Bi  ' ciRolDoQBi  s Ai  - <MoBo  + KbDo)QBo  <4-32> 

where  the  identities  (4.24),  (4.26),  and  (4.27)  have  been  used.  It  is  thus 
seen  from  (4.31)  and  (4.32),  that  the  limit  of  the  slow  mode  filter  is 
identical  to  that  of  the  reduced  problem,  i.e., 

sL(t)  - sQ(t)  + 0(*l/‘),  0 < t < T . 


(4.33) 
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4.4.  Summary 

| In  summary,  the  results  for  the  limits  of  the  backward  filter  are 

dual  to  those  of  the  forward  filter,  with  the  difference  that  the  boundary 
| layers  now  occur  at  the  right  endpoint  of  the  observation  interval.  It  should 

be  noted  that  there  is  no  innovation  in  the  backward  filter  and  thus,  the 
" observations  are  used  directly  as  inputs.  Specifically,  the  fast  backward 

■ filter  tends  to  a stationary  stretched  time-scale  filter  and  the  slow  mode 

filter  tends  to  the  reduced-order  backward  filter.  These  filter  outputs 
S will  now  be  appropriately  combined  with  the  forward  filter  outputs  to  obtain 

the  desired  smoothed  estimate. 

[ 

r 

I 

I 

I 

I 
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V.  NEAR  OPTIMAL  SMOOTHING  SOLTTION 


5.1.  The  Uncoupled  System 

5.1.1.  The  Near  Optimal  Slow  Mode  Smoother 

From  Section  2.3,  the  exact  smoothing  solution  is  given  by  (2.21). 
The  partitioned  matrix  representations  of  P(t)  and  M(t),  as  given  in  that  same 
section,  are  now  used  to  obtain  the  multiplicative  terms  of  (2.21)  as  follows: 


(1  + PM) 


I 0 


P P 

1 12 


o i / V P[2  P2/u/  Vmm[2  ^ 


I + P1M1  + 0(p,) 


P'  M + P M' 
12  1 2 12 


^(P1M12  + P12M2> 


I + P2M2  +0(h) 


(I+P^)"  +0(n) 


- n ( I+P  XMX ) ' 1 ( P jM 1 2+P  x 2M2 ) ( I+P2M2 ) ' L+0 (n2 ) 


(I+P2M2)'1(P[2M1+P2M[2)  (I+P1M1)”1+0(p.) 


(I+P^^+OOi) 


Thus,  it  follows  that  (I+PM)  P 


(I+P^r^+OOi)  (i+p1m1)'1[p12-(p1m12+p12m2)(i+p2m2)'1p2]+o(ia) 
-(i+p2m2)_1[ (p[2m1+p2m[2)(i+p1m1)’1p1-p[2]+0(h)  (i+p2m2)_1p  /h+0(1) 
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For  the  slow  mode  smoother,  the  quasi  steady-state  covariance  terms  can  be  used 
since  the  boundary  layer  terms  are  0(p,).  The  forward  and  backward  filters,  as 
given  by  (2.14),  (2.18),  (3.13),  and  (4.21)  together  with  (5.1)  and  (5.2), 
may  be  substituted  in  (2.21)  to  yield  the  slow  mode  smoother  as 

T)(t|T)  = (I  + P()M0)"1[Tl0(t)  + P0s0(t)]  + 0(^1/2) 

= Tl0(t | T)  + 00x1/2),  0 < t < T (5.3) 

It  is  now  clear  that  the  slow  mode  smoother  tends  to  the  reduced-order  smoother. 
Consequently,  if  the  fast  variable  is  of  no  interest,  a near  optimal  smoother 
for  the  slow  variables  may  be  obtained  by  solving  the  smoothing  problem  for 
the  reduced-order  system. 

5.1.2.  The  Near  Optimal  Fast  Mode  Smoother 

In  a similar  manner,  the  expressions  for  the  fast  mode  smoother 
may  be  obtained  in  the  interior  of  the  interval  [0,T],  by  substituting  the 
quasi  steady-state  values  of  the  covariances  and  the  filters  in  (5.1),  (5.2), 
and  (2.21)  to  yield 

l(t|T)  * (I  + P2M2)_1[C(t)  + P27(t)]  + 50(t|T)  + 0(n1/2)  (5.4) 

where 

* A — i A 

Vt|T)  = (I  +P2M2)'1[(N1+N2M0)T)0(t|T)  +1)^(0]  (5.5) 

and 

Nj(t)  = (a’1p2+  V^’ScJR^Cq  (5.6) 

N2(t)  = (A21-P2A^'1M2)B2QB(|)  (5.7) 


v*  i 
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It  should  be  emphasized  that  §Q(t|T)  is  an  output  of  a slow  system,  hence 
its  covariance  relative  to  that  of  £ is  0(p,).  Furthermore,  in  view  of  its 
being  a slow  variable,  it  need  not  be  performed  in  the  stretched  time-scale, 
and  merely  represents  a slowly  varying  "mean"  about  which  the  fast  components 
of  the  variable  5 (t | T) , namely  £(t)  and  r(t),  fluctuate. 

5.1.3.  Boundary  Layers 

If  a near  optimal  solution  for  the  fast  mode  smoother  is  needed 
during  the  entire  observation  interval,  the  boundary  layer  terms  need  to 
be  used  to  augment  the  fast  covariances  and  outputs.  Since  the  boundary 
layers  at  both  ends  of  the  observation  interval  were  shown  to  be  independent 
of  each  other,  the  results  are  greatly  simplified.  Augmentation  of  the  fast 
forward  covariance  in  both  the  forward  filter  gain  and  multiplicative 
terms  of  eq.  (5.4),  yields  the  near  optimal  fast  mode  smoother  valid  in  the 
left  boundary  layer.  This  simple  modification  of  the  time-invariant  smoother 
results  in 

iL(t  It)  = [i+  (P2  +Ts2(0))M2]"1[T(t)  + (P2+?2(e))7(t)]+i0(t|T)  +0(//2), 

0 < t < T-e  (5.8) 

where  Q (t)  is  the  time-varying  fast  filter  described  in  Section  3.5. 
Similarly,  the  time-varying  smoother  valid  in  the  right  boundary  layer  is 
given  by 

?R(t|T)  = [I  + P2(M2+M2(p))]*1[£(t)  + P2r(t)]  +50(t|T)  +0(//2), 

t 5 t < T 


(5.9) 
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where  r(t)  is  the  time-varying  backward  fast  filter  described  in  Section  4.2. 
Finally,  if  both  endpoints  may  be  needed  and  the  estimator  structure  is  not 
to  be  changed,  the  appropriate  smoother  is  given  by 

§L  R(t|T)  = U+  (P2+'P2(6))(M2+M2(p))]'L[~(t)  + (P2+'P2(0))'?(t)] 

* , 1/2 

+ §Q  (t  | T)  + 0(n  '*■)  , 0 < t < T (5.10) 

It  should  be  noted  that,  as  was  the  case  with  the  forward  fast  mode  filter, 
the  fast  mode  smoother  requires  no  boundary  layer  augmentations  for  the 
cross  covariances  and  M^Ct),  i.e.,  their  boundary  layer  terms 

always  appear  where  they  are  0(p,)  in  comparison  with  the  others. 

The  two  filter  formation  adopted  in  this  work  is  more  suitable  for 
analyzing  the  boundary  layer  behavior.  In  the  previous  formulation  [10], 
instability  problems  may  occur  from  the  interaction  of  the  two  boundary  layers. 
The  two  filter  approach  avoids  these  problems  by  allowing  two  separate  filters, 
each  with  its  own  independent  boundary  layer  at  the  two  opposing  ends  of 
the  observation  interval,  respectively. 

5.2.  Smoothing  for  the  Original  States 

The  near  optimal  fixed-interval  smoother  for  the  original  states 
x(t)  and  z(t)  defined  by  (1. 1)  — (1.3)  can  now  be  summarized,  using  the  earlier 
results  in  conjunction  with  the  inverse  transformation  (1.12),  in  the  following 
theorem: 

Theorem  1 : If  the  assumptions  (i)  and  (ii)  of  Section  1.2.4  hold  for  the 


system  (1.1)-(1.3),  the  smoothing  solution  for  the  original  states  satisfies 


the  relations 


1)  x(t|T)  = iQ(t | T)  + 0(^1/2),  0 < t < T 

where  x^(t|l)  is  the  smoother  for  the  reduced-order  problem  obtained  by 
setting  p,  = 0 in  (1.1)-(1.3)  (note  that  xQ(t|T)  5 ^(tlT)), 

2)  z(t|T)  = -A"1A21x0(t!T)  + §(t|T)  + 0(n1/2),  t < t < T-fi 

A 

where  5(t|T)  is  the  solution  for  the  fast  uncoupled  state  given  by  (5.4). 
If  a smoother  is  desired  which  is  valid  near  the  ends  of  the  observation 
interval,  one  needs  only  to  use  the  appropriately  modified  versions  of 
§(t|l)  as  discussed  in  the  previous  section. 

The  proof  of  this  theorem,  as  noted  in  Section  1.2,  follows  from 
the  results  of  the  previous  sections  together  with  the  linearity  of  the 
estimators  considered  in  the  sequel. 

As  a final  note,  it  should  be  pointed  out  that  the  resulting  four 
filters  involved  in  the  near  optimal  smoothing  solution  are  of  lower  order 
than  the  original  smoothing  solution,  and  can  be  implemented  in  two  time- 
scales  to  avoid  unnecessary  computational  burden  and  ill-conditioning  in 
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VI.  SPECIAL  CASE  AND  EXAMPLE 
6 . L . General  Stationary  Second-Order  System 

Consider  the  second-order,  time-invariant,  uncoupled  system  repre- 
sented by 


T\  = aQTl  + bQu,  11(0)  = T1q 

(6.1) 

= a25  + b2u,  §(0)  = 5q 

(6.2) 

y = cQT]  + c25  + v,  t > 0 

(6.3) 

where  u(t)  and  v(t)  are  uncorrelated  white  Gaussian  noise  processes  with  zero 
means  and  covariances  q and  r,  respectively.  The  transformation  of  Chapter  I 
allows  consideration  of  systems  of  the  above  form  (uncoupled)  without  loss  of 


generality.  Note  that  stability  requires  a^,  a^  < 0. 

The  exact  filtering  solution  is  given  by 

T1  = aQT]  + 7(Plc0  + P12c2)(y-c0T|-c2i),  T](0)=E(T10)  (6-4) 

= a2E+  ^■(p.CqP^ +c2p2)  (y  - cqT1  - c2i)»  S(0)  = E(5Q)  (6-5) 

where  p^>  p ^ , and  p2  satisfy  the  Riccati  equations 

?1  = 2a0P1+qbg  - (c£)P1  + c2P12>2/r , P1<0)  = cov(Tl0)  (6.6) 

Wl2  = (y'a0  + a2)p12  + qb0b2'(C0Pl  + C2P12)(tiC0P12+C2P2)/r> 

P12  (0)  = cov(T]0,§0)  (6.7) 

• 2 2 

HP2  = 2a2P2  + qb2  - (P^0P  12  + C2P2 ) /r’  P2  (0)  = p,cov(§0)  (6.8) 


^ r 


J 
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The  near  optimal  design  can  now  be  described  quite  easily  using 
the  results  of  the  previous  chapters  with  the  appropriate  simplifications 
due  to  this  second-order  system  with  scalar  coefficients.  Setting  p,  = 0 in 


(6.6)-(6.8),  using  the  results  of  Section  3.1,  yields  the  quasi  steady- 
state  covariances 


qb0b2  'C0C2PlP2/r 

(6 

• 9) 

P12 

2_ 

C2p2/r  ‘ a2 

H 

la. 

a2r  (1  " •J  r(/r)/c2 

(6 

.10) 

P1  s p0  = 

(b-8)k  exp  f -B t } - (b  + 8) 
2c(l  - k exp  { -B t } ) 

(6 

.11) 

where 

A 2cpl(0)  + (b  + P)  2 

k 2cpL  (0)  + (b-0)  ’ 3 ~ Vb0/r0 

(6.12) 

b $ 2(a0  -qd0b0c0/r0),  c 6 .c2Q/rQ,  & * j(>2 - 4ac, 

and 

d0i-c2b2/a2.  t0Sr  + ,dJ  (6.13) 

are  the  scalar  counterparts  of  the  matrices  (upper  case)  and  Rq  of  the 
previous  chapters. 

The  solutions  of  the  scalar  boundary  layer  equations  corresponding 
to  (3.7)  and  (3.8)  of  Chapter  III  are  given  by 

-2ra  k exp[2a  6] 

P?(6)  - ~ 2— , e-t/p,  (6.14) 

c2(1  - k2expt2®20 ^ 
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pl#> 


+p12(0)c2] 

C2^  * k2exP£2*?0  5 ) 


[exp{2«20}  -exp{a20]] 


(l'k-2  )pi2  (°)exp[a2®  1 
(l-k2exp{2a20 }) 

(6.15) 


where 


a2  - 


- 2, 

a2  * P2C2/r* 


A V2(°> 
C2P2(0)  ' 2ra2 


(6.16) 


The  near  optimal  fast  mode  filter  is  given  (in  a stretched  time- 


scale)  by 


dT  ? a2^  + r P2C2(y  ' C0^0  ‘ C2^  ’ T 


t-t. 
i 

U 


> 0 


(6.17) 


where  p2  (0 ) must  be  added  to  p..  to  account  for  the  boundary  layer  behavior 
near  t = 0. 


The  near  optimal  slow  mode  filter,  which  is  found  from  the  reduced 


system  as  seen  in  Chapter  III,  is  described  by 


^0  ao^o  + ko^y  ” coV 


where 

ko  - (poco  + qdobo)/ro 


Similarly,  the  exact  backward  filtering  solution  is  given  by 


dsi(t)  2 cQ 

“d^ = (a0  'mlqb0  ' m12qb0b2)sl  ’ (mlb0+m12b2)qb2S2  +T  y’  si(T)=0  (6.20) 

ds2(t)  2 C2 
u-j^ * - (Hm12b0  +m2b2)qboSl  + (a2-M,m12qb()b2-m2qb2)s2  +—  y,s2(T)  = 0 (6.21) 


where  m^,  m^,  anc*  m2  satisfy  the  Riccati  equations 


(6.18) 


(6  19) 


1 2 2 
"do"  = 2a0ml+C0/r_<»(ralb0+m12b2)  1 


m^T)  =0 


— = (^a0  + a2)m12 + cQc2/r  - q(m1b0  + m12b2)(tim12b()+m2b2),  m12(T)  = 0 (6.23) 


2a2m2  + c2/r  - q (^m12b0  + )2 , 


m2(T)=0  (6.24) 


As  was  shown  more  generally  for  the  (n  + m)-th  order  case  in  Section  2,3,  the 
Riccati  equations  (6 . 22 ) - (6 , 24)  are  the  exact  duals  of  their  forward  counter- 
parts (6.6)-(6.8).  Thus,  the  quasi  steady-state  solutions,  trivially  found 
by  merely  substituting  the  dual  coefficients  in  (6 . 9) - (6 . 11) , are 


CQC2/r  ’ <’b0b2mlm2 


qb2m2  - a2 


(6.25) 


m2  = a2(x 


+ qd2/r)/qb2 


(6.26) 


— _ 2c[  1 - expf  -Boll 

mi  = mo  = Rb-3):(bVp)eiJ{-p«T}] 


(6.27) 


where  the  boundary  condition  mg((j=0)  =0  has  been  used. 


The  solutions  to  the  boundary  layer  equations,  using  duality,  are 


given  by 


m2  (p ) 


2v2m2exp{2v2p} 

2a2  - qb2iii2(l  + exp{2v2p}) 


(6.28) 


2m12(0)eXp^V2P^qb2m2expf-V2P-*  'a2J 

m12^P^  = 2^-  I 

2a2  * qb2m2 1 + exPt2v2p^ 


(6.29) 


c 


where 


- A 2_ 

V2  * a2  * qb2m2 


The  near  optimal  stretched  time-scale  backward  filter  is  described 


dr(t)  _ , . 2-  v-  2 

"dX  (a2-qb2m2)r+Ty« 


ff-C7i 

x = — - > 0 

M- 


where  m^(p)  is  to  be  added  to  n>2  if  the  boundary  layer  behavior  is  desired. 
The  near  optimal  slow  mode  backward  filter  satisfies 

ds0(t) 

- £ — = 1 ao  ■ (mobo  + kbd0)qb01  s0  + kby  (6  • : 


where 


kb(t)  A (co'moqbodo)/ro 


Finally,  the  near  optimal  fixed-interval  smoothers  are  given 


T](t|T)  =T|n(t|T)  = [Tl0(t)+P()s0(t)]  n^t) 


* (lit)  + (p  +p  (0))*r(t)] 

„(t|T)  £ — + 5 (t |T), 

[1+  (F2  + P2(e))(S2+m2(6))]  0 


0 < t < T 


§Q<t  | T)  = l(n1+n2m0)Tl0(t|T)  + n2sQ(t ) ] / ( 1 + p2m2  ) 


(6.36) 


nl(t)  ^ (p2/a2 +p2/v2)c.2c0/r  , n2(t)  6 (l/a2-  P2m2/'v2)qbob2  <6-37) 


and  £(t)  and  r(t)  are  the  time-varying  filters  of  (6.17)  and  (6  31). 
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6 .2  Relation  to  the  Wiener  Filter 

6 2.1.  Realizable  Wiener  Filter 

In  light  of  the  boundary  layer  behavior  of  the  filter  for  the  fast 
mode  §(t),  as  given  by  (6  17),  it  would  seem  reasonable  that  the  realizable 
Wiener  filter  should  be  considered  as  a possible  substitute  More  specifi- 
cally, if  the  smoothing  interval  is  at  least  a few  fast  time-constants  long, 
the  estimate  §(t/T),  as  given  by  (6.35),  could  incorporate  this  Wiener  filter 
in  the  interior  of  the  interval.  Assuming  that  T represents  a small  delay, 
a sufficiently  small  p is  required.  Note  that  a Wiener  filter  would  provide 
a very  poor  estimate  for  the  slow  mode,  in  general.  However,  as  was  pre- 
viously seen,  the  simple  reduced  system  filter  (6.18)  can  be  easily 
implemented  to  estimate  T)(t).  The  above  statements  apply  similarly,  to 
the  backward  filters  also.  While  the  covariance  of  the  realizable  Wiener 
filter  can  never  be  achieved  for  finite  T and  non-zero  p,  it  does  serve  as 
a useful  lower  bound  which  can  hopefully  be  obtained  in  the  limit  as  p 
(and  subsequently,  the  boundary  layer  width)  tends  to  zero. 

It  has  been  shown  in  the  previous  chapters  that  P2(t)  can  be 
expressed  as 

P2(t)  = P2  + °(ti)  (6'38) 
for  t > £ > 0,  and  thus  the  covariance  of  the  optimal  fast  mode  filter  of 
(6.5)  can  be  written  as 

E(e2(t))  = p2/p  + 0(1),  t>e  (6.39) 

i.e.,  as  p-*0,  the  error  covariance  tends  to  infinity  asymptotically  in  such 

2 

a way  that  the  product  pE(e  (t))  tends  to  a constant,  namely 
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The  error  covariance  of  the  realizable  Wiener  filter  HqQuu)  [19] 
for  estimating  ?(t)  from  the  noisy  observations  y(t),  as  given  by  (6.1)- 
(6.3),  will  now  be  investigated.  The  model  for  the  channel  and  filter  is 
shown  in  Figure  1.  The  two  signals,  s^(t)  = cQT](t)  and  s2(t)  = c2§(t),  are 
modeled  by  white  noise  (with  covariance  q)  thru  linear  filters,  as  shown  in 
Figure  2.  Note  that,  for  the  purpose  of  estimating  £(t),  T](t)  is  essentially 
an  additional  noise  process.  From  these  two  figures,  it  is  seen  that  the 
power  spectra  satisfy 


0 (oo) 
S1 


,2  2 
qboco 
2 2 
* +a0 


0-  (<D) 


.2  2.  2 

qb2c2/p. 

2 2,2 

0)  +a  /p, 


(6.40) 


and 


0n(ou)  = 0s  (uu)+0v(ou) 


.2  2 
qboco 
2 2 
+ao 


+ r. 


(6.41) 


where 


0y(u u)  = 0g  (uu)+0n(o))  + 2Re0s  n(jou) 


qfc0b2C0C2/y’ 


(6.42) 


(6.43) 


2 1 


Substituting  (6.40),  (6.41),  and  (6.43)  in  (6.42)  yields 


0y(uu) 


ru)4+[  q (b0c0+b2c2  /^) 2+r  (a2+a2 /|ji2 ) ] u)2+[  q (a2b()c0+a0b2C2  )2+raoa2 1 ^ 

(o»2  + a2)  (a)2  + a2/p,2)  (6.44) 


Using  spectral  factorization,  0y  (oj)  becomes 

+ (jou  + OU^)  (j<i>  + u^)  ^(u)^  - jou)  (u^  - ju>) 

0y  (lU)  (ju>  - a0)(juj  - a^)  (ju)+ aQ)  (ju>+ a^)  (6.45) 
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Figure  2.  State  Model 
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where  uj^m^  > 0 and  ag,a2  < 
Thus , 


G(juu)  = 


0,„(ju>)  Hd(u,)0s2y(ju,)  Hd (u>)  (0S^ (u>)  + 0S^S^ (ju>) ) 


0y"  (jU>)  0y‘(jU)) 


0y”  (jUj) 


(6.46) 


Substitution  of  the  indicated  quantities,  together  with  a partial  fraction 
expansion,  yields, 


G+(juu)  = 


<|l>2k4 


where 


M«s/r  (jou-a,/p,) 


k4  = 


1 + -AQ/r 


+ Ofo) 


(6.47) 


(6.48) 


The  error  covariance  is  given  by 

.2,^,  2 2 


E(e  (t))  = E (z2  (t)  ) - E (z  (t ) ) = J [ 0z  (uu)  - |G+(ja>)  | 2 ] dou 

-00 

_ 0 (Uj) 

1 r-  2 ® o 

= 2tt  J 2 ^ - J 8 (t)dt 

-oo  r 

2 


using  Parseval 1 s theorem.  From  (6.47), 


qb 


g+(t)  = _ k4exp{-a  t/n) 

M*A 


Simple  integration  yields 


qb 


M-E  (e  (t))  = - Jl — (1  - qdQ/r  (1  +7rQ/r  ) ) + 0(p,) 


(6.49) 


(6.50) 


(6.51) 
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which  after  algebra  reduces  to 

M.E  (e2  (t ) ) = ra2(l  - I c\+ 0^)  s?2+0(y)  (6.52) 

Thus,  as  y,  tends  to  zero,  the  error  covariances  of  the  fast  mode  filter 
(outside  the  boundary  layer)  and  the  realizable  Wiener  filter  agree. 


6.2.2.  Unrealizable  Wiener  Filter 

A similar  argument  to  the  one  made  to  justify  replacing  the  fast 
mode  filter  with  the  realizable  Wiener,  can  be  given  to  justify  the  use  of 
the  unrealizable  Wiener  filter  in  place  of  the  fast  mode  smoother,  given 
by  (6.35).  In  the  interior  of  the  smoothing  interval,  for  y sufficiently 
small,  the  effects  of  the  two  boundary  layers  have  decayed  to  zero.  The 
fast  mode  smoother,  in  other  words,  experiences  a long  past  and  future 
of  essentially  steady-state  behavior.  The  unrealizable  filter  error  co- 
variance  cannot  be  obtained,  but  it  provides  a lower  bound  for  the  fixed- 
interval  smoother.  As  before,  it  is  hoped  that  as  y tends  to  zero,  the 
respective  covariances  will  agree. 

Equation  (2.6)  gives  the  smoother  error  covariance  matrix  P(t|T) 


as 


P(t|  T)  = [ P"  L (t ) + M(t ) ] 


(6.53) 


For  the  second-order  case  in  the  interior  of  the  interval,  the  quasi 
steady-state  covariances  are  valid  to  within  0(y).  Thus, 


P (t  | T) 


-1 


(6.54) 


_k_ 
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The  covariance  for  the  fast  mode  smoother  is  then  given  by 

A I 2 <m,  +P?/|id  ) 

E[  (§  (t  IT)  - ?(t)  ] = — — ± ^ L- (6.55) 

(m1+p2/|id1)(nm9  +P1/d1)  - (P,m12  ‘ p12/dl) 

where 

dl  “ PiP2^  ‘ V 12  (6.56) 


Simple  algebra  reveals  that 


nE[(S(t|T)  -§(t))2]  = P2/(1  + P2m2)  + 0(n) 


qra2b2(l  -VrQ/r) 


2 2 


[ qb2C2  +ra2^1  'v/r0/r>  1 


qb2 

+ 0(h)  - _ t 


1 -Vr0/r 


2 *A0/r  (l-VrQ/r) 


] + 0(  pi  ) 


2a 


2*/ 


ro/r 


+ 0(h) 


(6.57) 


The  model  for  the  unrealizable  filter  is  given  also  by  Figures  1 and  2. 
This  filter,  to  be  denoted  Hqu(ju)),  is  however  different  from  the  realizable 
HqOoj).  Equations  (6 .40)  - (6 .44)  are  still  applicable,  but  the  error  co- 
variance  is  given  here  by 


MMSE 


2 2 ] °°  i 08  7 

= E (z  (t))  - E (z  (t))  = — J 0z  (ou)duj  - J*  |H0u(j«))|  0 («,)doo 


0e  Coo)  1 0 (uu)  +0  (oo)  I ' 


‘ h J lHd<»|2[»  s <»>  - «■*«.)  + / («,)+»\W  J ““ 


S2S1 


2^J 


.2,  2 , 2W  2 

qb2(u>  +aQ)/H 


duo 


-co  uo4+[a2+a2/H2+q(b0c0+b2c2/H)2/rluu2+[a2a2+q(a0b2c2+a2b0c0)2/r]/H? 

(6.58) 


*■  ** 
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Factoring  the  denominator  polynomial  yields 

2 2 2 2 
, “ qb  (uo  + a_) / p, 

MMSE  = ~ f —2 du, 

2n  J , 2±  2W  2l  2, 

-®  (uo  d-S^XlU  +s2) 


I r“^2 

n J 2 

0 y. 


2 2 
a0  ' sl 
K 2 2m 
S2‘S1 


2 , 2 
UO  + 


-ar 


) + (- 


2 2 ' 
-r><'2 


1 


duo 


S2  * S1 


U)  + S„ 


(6.59) 


by  employing  a partial  fraction  expansion  and  noting  the  even  symmetry. 


Integration  results  in 
2 


qb 


MMSE 


22  / 4 2, 

2 r a0~Sl  + (S2~a0)1 

S,  s2 


0 2.  2 2 o. 

2p.  (s2  - s1)  1 


(6.60) 


where 


/ra^  + q(a0b2c2+a2b0c0)2 

S1  / 2 2~2  + °^) 
ra2  + qb2c2 


(6.61) 


s2=  ( -a2  v'rQ/r)/M(  + 0(l) 


Thus,  it  is  easily  seen  that 
qb2 

^MISE  = + 0(n)  = - 


qb' 


2a 


i2v'r0/r 


+ O(^) 


(6.62) 


which  is  identical  to  (6.57),  proving  that  as  |j, ->  0 the  fast  smoother  per- 
formance tends  to  that  of  the  unrealizable  Wiener  filter. 


I 
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I 
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6.3  Numerical  Example 


6.3.1.  Near  Optimal  Design 


The  system  to  be  studied  in  this  section  is  of  the  form  of  equations 


(6 . 1 ) - (6 . 3)  with  aQ  = - 1 , a2=  -2  , bQ  = = cQ  = q = 1 , c2  = 2 , r = 0.5,  T=l,  i.e., 


T1  = -Tl  + u 

W =T1q 

(6.63) 

p?  = -2§  + u , 

5(°)  "So 

(6.64) 

y = T)  + 2§  + v , 

0 < t < 1 

(6.65) 

where  T]q  and  | are  random  variables  with  zero  means  and  covariances 
satisfying 

cov(T]0)  =2,  cov(T]0,§0)  =0,  cov(§Q)  = 1/p.  (6.66) 

Application  of  (6.4)-(6.8)  to  the  above  system  yields  the  exact 
filtering  solution  as 


T]  = -T1  + 2(Pl  + 2p12)(y  -71-2?), 

T)  (0)  = 0 

(6.67) 

p?  = -25  + 2(pp12  + 2p2)  (y  -T1  - 25), 

5(0)  = 0 

(6.68) 

P1  = '2pl  + 1 * 2(Pi  +2p12)2, 

P^O)  = 2 

(6.69) 

ppi2  = -(2  + p)P12  + 1-2 (Pl + 2p12)  (pp12  + 2p2), 

p12(0)  = 0 

(6.70) 

. 2 
Pp2  ^ *4p2 + 1-2 (^pi2  + 2p2^  > 

P2(0)  = 1 

(6.71) 

The  quasi  steady-state  covariances  are  given  by 

' P2-03-»/4  <6.«) 

I 
I 

| 
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= (3  + 275)  exp(-Z,/3tl  - (3-275) 
("3  +«/3)  exP{-2y3t}  + (3+75) 

exp(-zy3tl  + (1  -75) 

(73-1)  exP{-273t]  - (1+73) 


(6.73) 


(6.74) 


The  boundary  layer  terms  (substituting  in  (6.14)  and  (6.15))  become 


^ (9)  = _(573  - 3)  exp  [-4736] 

2[  Cv/3  - 5)  exp [-4730  } + (5+73)] 

~ (e  ) = (^/3  - 3)exp{ -4730] -373  exp] -2738] 
<7?  - 5)exp{-4/30  ] + (5+75) 


(6.75) 


(6.76) 


From  equation  (6.17),  the  time  varying  fast  filter  equation  is 

given  by 

C :r  -2„  + [75  - 1 +4p2(4)]  (y-2C)  (6.77) 

and  the  slow  filter  satisfies 

\ = ‘^0 + f (1  + po)(y  _V  (6.78) 

Similarly,  the  exact  backward  filtering  solution  satisfies 

= -(l +mL +m12)s1-(m1 +m12)s2 + 2y,  Sl(T)=0  (6.79) 


= -(nm12  +m2)s1*(2  +M-m12  +m2)s2  +4y,  s2(T)=0  (6.80) 


dSj 

da 


dsr 


da 
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I 

I 

I 

I 


I 

I 

I 

I 

I 


■2m^  +2-(m1  +m12) 


2 


m1  (T)  = 0 


dm 


12 


— = * ((J.  + 2)  m12+4-(m1 +m12)(pm12 +m2), 


m12  (T)  = 0 


dm2  2 
U ^-  = -4m2  + +m2)  , 


m2  (T)  = 0 


The  quasi  steady-state  covariances  are  given  by 

m2  = 2(j3  - 1) 

_ 2[  1 - expf -273a  ll 

m = m = 1 ^ — * v IJ , a = T - t 

(5  + 3/3)  + 0/3  -5)  exp{-2A/3a] 

- _ 4[  (3+75)  + (273  -J)  expf  -2^11 

12  [(573  + 9)  + (9  -5^3)  exp{-2v/3<j}] 

The  boundary  layer  terms,  as  given  by  (6 . 28)  - (6 . 29),  become 

~ (p)  -4(3-73)  expf  -\/5o  1 

2 + C/5  - 1)  [ 1 + expf -4/5p  } ] 

^ (p)  = . 473[(/3  - l)exp(-473pl +expf-273p]] 

6+3C/3-1)  [1  + exp  {-*«/5p}] 

The  near  optimal,  time-varying  fast  mode  filter  is  described 
= -[  275  + n»2  (p  ) ] 'r+4y 


V 


(6.81) 

(6.82) 

(6.83) 

(6.84) 

(6.85) 

(6.86) 

(6.87) 

(6.88) 

(6.89) 


I 

I 

I 

I 


I 

t 

I 


I 

I 

I 


I 
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and  the  slow  filter  satisfies 


dsQ(t)  (5+m0) 

3 s0  + 3 (1-m0)y  (6‘90) 

with  ni^ft)  as  given  by  (6.85). 

The  near  optimal  smoothing  solution  is  now  given  by  equations 
(6 . 34) - (6 . 37 ) of  Section  6 . 1,  in  terms  of  the  four  near  optimal  filters 
((6.77),  (6.78),  (6.89),  (6.90))  just  obtained,  and  the  time-varying  coeffi- 
cients explicitly  evaluated  in  this  section. 


6.3.2.  Performance  Comparison 

In  this  section,  several  graphs  are  presented  indicating  the 
results  of  various  performance  comparisons  among  the  near  optimal  and 
optimal  estimators,  as  just  computed  in  Section  6.3.1.  These  results 
illustrate  how  closely  the  near  optimal  design  can  approximate  the  optimal. 
While  the  results  of  one  numerical  example  do  not  constitute  a proof,  they 
do  suggest  the  general  requirements  to  obtain  a close  approximation,  as 
will  be  noted  in  the  summary.  Computer  solutions  of  the  exact  Riccati 
equations,  as  given  by  (6 .69) -(6 . 71) , were  employed  to  obtain  the  optimal 
performance.  The  near  optimal  design,  as  seen  earlier  in  this  section, 
can  be  explicitly  evaluated  as  a function  of  both  t and  p,  given  the 
remaining  system  parameters.  Having  obtained  the  performance  of  the 
optimal  estimates,  the  relative  proximity  (to  the  exact)  of  the  near  optimal 
design  can  be  tested.  In  addition,  various  convergence  results,  as  p 
tends  to  zero,  for  both  the  fast  and  slow  modes  can  be  illustrated. 
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Figure  3 shows  the  uniform  convergence  of  the  optimal  error 
covariance  for  the  slow  mode,  p^(t,p)  to  p^  as  y.  tends  to  zero.  The 
effect  of  changes  in  p.  on  the  optimal  slow  mode  covariance  is  seen  to 
be  small,  as  in  the  steady  state,  p^*,  0. 1)  = 0. 1 16 143 , p^l®,  0.05)  = 
0.107479,  Pl(«,  0.01)  = 0. 100016,  p («)  = 0.098070. 

The  error  covariance  v^(t),  of  the  near  optimal  slow  mode  filter 
(6.78)  using  the  (actual)  full  system,  i.e.,  (6 .63)- (6 .65) , can  be  found 
by  forming 

e = Ae  + Bn 


where 


_ 

T1  - 

> 

A = 

- ( 1 + k ) 
0 

-2ko1 

§ 

- 

0 

-2/ J 

"l 

V 

u(t) 

B = 

l/u 

0 

, n = 

y(t) 

• 

The  related  equation 

V = AV  + VA'  + BQB ' (6.92) 

where  V(t)  = E(e(t)e'(t))  and  Q = (q  \/2  ^ covariance  n(t),  thus 

2 

has  as  its  first  element  v^  (t , p)  = E[  (T1  - T|q)  ].  Using  this  information 
together  with  the  optimal  covariances  p^(t,p)  from  Figure  3,  the  magnitude 
of  the  0(p,)  term  is  found.  Figure  4 displays  this  difference,  e^(t), 
between  the  near  optimal,  slow  mode  filter  error  covariance  and  the  optimal 
covariance  as  a function  of  t for  p,  * 0.1,  0.05,  and  0.01.  Inspection 


■V 


> 


I 
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of  the  three  curves  reveals  an  interesting  relationship  among  them.  For 
t > .05,  the  performance  of  the  near  optimal  reduced  system  filter  T|q (t) 
converges  to  the  optimal  (as  would  be  expected,  since  p is  ignored)  as 
p-»0.  However,  in  an  initial  boundary  layer,  the  fast  modes  dominate 
the  system  ever  increasingly  as  p -» 0 and  subsequently,  the  observations 
also.  The  reduced  system  filter,  which  has  no  provision  for  estimating 
the  fast  mode  §(t),  is  essentially  misled  by  the  initial  observations,  which 
actually  convey  relatively  little  information  about  T|(t).  In  the  steady- 
state,  the  reduced  system  filter  performs  extremely  well  as  e^(oc,  0.1)  = 
3.29xl0"3,  e]L  (®,  0.05)  = 1.72  x 10'3,  e^®,  0.01)  = 3.6 1 x 10"4  and,  as 
Figure  4 indicates,  converges  to  the  optimal  as  p-*0. 

The  behavior  of  the  optimal  covariance  p2(t,p)  in  the  boundary 
layer  is  exhibited  by  Figure  5,  as  p^(t)  is  plotted  for  t < 0.05  for  three 
values  of  the  parameter  p.  What,  these  graphs  show  is  the  convergence  of 
P2(t>M')  to  ?2  as  ^_>0,  except  in  an  initial  boundary  layer  (where  the 
initial  condition  is  constrained  to  be  1).  Also  they  illustrate  the 
rapidity  at  which  the  boundary  layers  decay  as  p-»0.  What  cannot  be  seen 
on  such  a short  time  plot  as  this,  is  that  the  three  curves  later  cross 
and  in  the  steady  state  P0  (®> 0)  = p.}  = C . 183013 , p^  (°°, 0.  01)  = 0. 182449, 
p^  (®, 0.05)  = 0. 180255  , and  p , (® , 0 . 1 )=  0.  177634  , The  convergence  would  be 
uniform  if  not  for  the  small  neighborhood  where  the  curves  cross  the  constant 
value  p 

It  should  be  noted  that  these  last  results  can  be  interpreted  in 
terms  of  the  fast  filter  covariance.  The  filter  error  covariance  of  §(t) 


as  given  by  (6.68) 


Is  p (t,p)/p.  Although  P2(t,p2)  > p2(t,p1)  for 


I 


I 

I 

I 

I 
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Figure  5.  Boundary  Layer  Convergence-Fast  Mode 
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^2  > p^  in  the  boundary  layer,  the  covariance  for  the  smaller  value  p^ 
is  still  significantly  larger  than  with  p^ , i«e.,  the  filter  performance 
is  worse.  Of  course, this  is  due  solely  to  the  fact  that  the  fast  state 
§(t)  is  tending  to  a white  no'ise  process.  Thus,  while  P2(t,p)  converges 
to  Pj  as  p-»0  outside  the  boundary  layer,  no  such  statement  can  be  made 
about  the  fast  filter  error  covariance. 

The  actual  error  covariance  of  the  near  optimal  fast  mode  filter 
(6.77)  can  be  found,  as  was  done  for  the  slow  mode,  by  forming 


e = Ae  + Bn 


(6.93) 


where 
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Then  v^  (t) 


El  (§-|)2] • where 


(6.94) 


V = AV  + VA’  + BQB'  (6.95) 

The  resulting  error  covariance  v^(t)  for  this  particular  example  agrees 

. 3 

to  within  a maximum  deviation  of  10  of  the  optimal  for  all  three  values 
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of  p,f  as  given  in  Figure  5.  They  were  not  plotted  since,  for  all  intents 
and  purposes,  the  graphs  would  appear  the  same  as  those  of  Figure  5. 

In  Figure  6,  a comparison  is  made  between  the  optimal  covariance 
P2(t)  and  the  near  optimal  gain  terms  p^  and  p2  +^2(6)  for  p = 0.1.  Note 
that  the  pp^  term  was  neglected  in  the  optimal  fast  mode  filter  gain, 

(PP12  + 2P2).  It  is  easily  seen  that,  as  expected,  the  selection  of  p=0.1 
(results  were  obtained  for  p = 0.01,  0.05,  0.1)  produces  the  greatest 
discrepancy  among  the  three  values  of  p.  That  is,  as  p-*0,  the  approximation 
continually  improves.  Inside  the  boundary  layer,  the  addition  of  "p ) to 
P2  is  needed.  The  approximation  (only  shown  for  t < 0.05)  remains  close 
throughout  the  entire  interval  as  in  the  steady-state  p2 (°°,0. 1)  = 0. 177634, 

P2  =0.183013.  This  near-perfect  approximation  of  the  optimal  gain  term 
accounts  for  the  essentially  optimal  performance  as -just  noted  above. 

Nearly  identical  results  for  the  near  optimality  of  the  lower- 
order  backward  filters  were  obtained.  Since  the  same  singular  perturbation 
methods  were  used,  this  was  to  be  expected.  Equation  (2.6)  of  Section  2.1 
then  guarantees  the  near  optimality  of  the  smoother.  That  is,  near  optimal 
filtering,  both  backward  and  forward,  assures  a near  optimal  smoothing 
solution.  Figure  7 illustrates  the  closeness  of  the  near  optimal  backward 

__  /*w  __ 

fast  mode  filter  gain  term  {l^+l^O)]  to  the  optimal  M2(uM19  neglected  by 
duality)  for  t > 0.95  and  u = 0.1. 

Figure  8 illustrates  the  improvement  in  terms  of  error  covariance, 
of  smoothing,  relative  to  filtering,  for  the  slow  mode.  The  highest  value, 
u = 0.1,  was  again  chosen,  since  the  advantage  of  smoothing  decreases  as 
as  p -•  0 . 
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Two  comparisons  have  been  made  for  the  fast  mode  estimators  in 

Figure  9 using  u = 0.1.  in  the  smaller  plot,  the  comparison  of  smoothing 

and  filtering  error  covariances  is  displayed  for  0 < t < T,  and  in  addition, 

it  is  shown  that  the  smoother  (in  the  interior  of  the  interval)  performs 

nearly  as  well  as  the  unrealizable  Wiener  filter  H ( jui) . Note  that  the 

ou 

smoothing  error  covariance  P^CtlT)  exhibits  boundary  layers  at  both  ends  of 
the  interval.  The  required  terminal  condition  M2 (T)  = 0,  due  to  filter 
and  smoother  performance  equivalence  at  t = T,  allows  a relatively  small 
right  boundary  layer  decay.  The  left  boundary  layer,  however,  is 
indicative  of  a large  discrepancy  between  the  initial  rendition  and  steady- 
state  value  of  ^(t).  This  transient  behavior,  which  is  difficult  to 
distinguish  on  the  smaller  plot  is  magnified  for  easier  comparison  (t  < 0.05) 
on  the  larger  graph.  Note  that  while  smoothing  and  filtering  performance 
are  identical  at  the  end  of  the  interval,  smoothing  represents  a drastic 
improvement  over  filtering  initially  for  this  particular  singularly  perturbed 
system. 

The  results  of  this  numerical  example  are  pleasing.  Not  only 
has  convergence  of  the  optimal  covariances  been  illustrated,  but  the 
relative  performance  of  the  near  optimal  design  has  proved  to  be  incredibly 
good  for  values  of  j.  as  large  as  0.1.  The  advantage  of  smoothing  over 
filtering  for  both  the  slow  and  fast  mode  has  also  been  shown.  Finally, 
as  predicted  for  u sufficiently  small,  the  close  approximation  of  the 
smoother  covariance  (in  the  interior  of  the  interval)  to  that  of  the 
unrealizable  Wiener  filter  has  been  demonstrated. 


Figure  9.  Comparison  of  Filtering,  Smoothing  and  Unrealizable 
Wiener  Filter  Error  Covariances  for  the  Fast  Mode 
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VII.  SUMMARY  AND  CONCLUSIONS 

A near  optimal  fixed-interval  smoother  for  singularly  perturbed 
systems  has  been  derived  using  the  two  filter  (forward  and  backward)  formu- 
lation. This  intuitively-pleasing  approach  simplifies  the  fast  mode 
boundary  layer  complications  encountered  previously,  in  [10]  and  results 
in  a much  simpler  implementation  than  the  exact  solution.  Application  of 

similar  singular  perturbation  techniques  as  for  the  (forward)  filter  in 

1/2 

[1,9,10],  to  the  backward  filter,  results  in  a near  optimal  0(y  ) 

smoother  with  a similar  two  time-scale  solution  for  the  fast  and  slow  modes. 
The  alternative  use  of  the  unrealizable  Wiener  filter  for  the  fast  mode  was 
justified  in  the  interior  of  the  smoothing  interval.  Finally,  a numerical 
example  served  to  illustrate  how  well  the  near  optimal  design  approxi- 
mates the  exact  for  various  values  of  the  perturbation  paramter  y. 

In  conclusion,  it  can  be  inferred  from  the  analysis  of  Chapter  VI, 
that  the  near  optimal  design  will  yield  a close  approximation  (for  y 
sufficiently  small),  when  the  system  parameters,  excluding  y,  agree  to 
within  approximately  an  order  of  Magnitude . This  restriction  can  be 
progressively  relaxed  as  y-*0.  It  should  lastly  be  noted  that  the  methods 
and  results  of  this  thesis  lend  themselves  quite  easily  to  systems  with  a 
hierarchy  of  modes.  The  implementation  necessary  to  obtain  the  estimates 
of  the  system  states  similarly,  would  be  multi-time-scale  utilizing  a 
reduced-order  solution  for  the  slow  modes. 
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